HAPS-UAV-Enabled Heterogeneous Networks: A Deep Reinforcement Learning Approach
نویسندگان
چکیده
The integrated use of non-terrestrial network (NTN) entities such as the high-altitude platform station (HAPS) and low-altitude (LAPS) has become essential elements in space-air-ground networks (SAGINs). However, complexity, mobility, heterogeneity NTN resources present various challenges from system design to deployment. This paper proposes a novel approach designing heterogeneous consisting HAPSs unmanned aerial vehicles (UAVs) being LAPS entities. Our involves jointly optimizing three-dimensional trajectory channel allocation for base stations, with focus on ensuring fairness provision quality service (QoS) ground users. Furthermore, we consider load stations incorporate this information into optimization problem. proposed utilizes combination deep reinforcement learning fixed-point iteration techniques determine UAV locations strategies. Simulation results reveal that our learning-based significantly outperforms conventional benchmark models.
منابع مشابه
Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks
This paper investigates the use of deep reinforcement learning (DRL) in the design of a “universal” MAC protocol referred to as Deep-reinforcement Learning Multiple Access (DLMA). The design framework is partially inspired by the vision of DARPA SC2, a 3-year competition whereby competitors are to come up with a clean-slate design that “best share spectrum with any network(s), in any environmen...
متن کاملReinforcement Learning in Neural Networks: A Survey
In recent years, researches on reinforcement learning (RL) have focused on bridging the gap between adaptive optimal control and bio-inspired learning techniques. Neural network reinforcement learning (NNRL) is among the most popular algorithms in the RL framework. The advantage of using neural networks enables the RL to search for optimal policies more efficiently in several real-life applicat...
متن کاملReinforcement Learning in Neural Networks: A Survey
In recent years, researches on reinforcement learning (RL) have focused on bridging the gap between adaptive optimal control and bio-inspired learning techniques. Neural network reinforcement learning (NNRL) is among the most popular algorithms in the RL framework. The advantage of using neural networks enables the RL to search for optimal policies more efficiently in several real-life applicat...
متن کاملMulticast Routing in Wireless Sensor Networks: A Distributed Reinforcement Learning Approach
Wireless Sensor Networks (WSNs) are consist of independent distributed sensors with storing, processing, sensing and communication capabilities to monitor physical or environmental conditions. There are number of challenges in WSNs because of limitation of battery power, communications, computation and storage space. In the recent years, computational intelligence approaches such as evolutionar...
متن کاملLearning how to Active Learn: A Deep Reinforcement Learning Approach
Active learning aims to select a small subset of data for annotation such that a classifier learned on the data is highly accurate. This is usually done using heuristic selection methods, however the effectiveness of such methods is limited and moreover, the performance of heuristics varies between datasets. To address these shortcomings, we introduce a novel formulation by reframing the active...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE open journal of the Communications Society
سال: 2023
ISSN: ['2644-125X']
DOI: https://doi.org/10.1109/ojcoms.2023.3296378